Multimodal and multi-informational neuronavigation

This paper presents the principle of multimodal and multi-informational neuronavigation as well as the data fusion environment we have developed for these techniques. Our fusion environment supports the planning step and includes registration, segmentation, 3D visualisation as well as data browsing and interaction tools. We provide a neuronavigation system with relevant information for the performance of the surgical act. The information is extracted from multimodal data such as magnetic resonance imaging (MRI), magneto-encephalography (MEG) and functional magnetic resonance imaging (fMRI). We demonstrate multimodal neuronavigation on a clinical case with multimodal information injected in the overlay (head-up) display of a neurosurgical microscope (Surgical Microscope Navigator by CARL ZEISS, Oberkochen/ Germany). Our first experiences show that being able to access pre-operative functional and anatomical data within the neuronavigation system adds valuable support for the surgical act in many surgical contexts (cavernoma, low grade tumours, . . . ).